ASYMPTOTIC NORMALITY FOR TRACES OF POLYNOMIALS 
IN INDEPENDENT COMPLEX WISHART MATRICES 
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Abstract. We derive a non-asymptotic expression for the moments of traces 
of monomials in several independent complex Wishart matrices, extending 
some explicit formulas available in the literature. We then deduce the explicit 
expression for the cumulants. From the latter, we read out the multivariate 
normal approximation to the traces of finite families of polynomials in inde- 
pendent complex Wishart matrices. 



1. Introduction 



The complex Wishart distribution was introduced by Goodman (Goodm an 1963b|) . 
and studied by numerous authors, starting with (Goodman 1963a; IKhatri 1965bl 
IKhatri 1965al Srivasta va 1965|) . Following (Graczyk, Letac & Massam 2003), we 



define the complex Wishart law by specifying its Laplace transform. 

Definition 1.1. Let E be an NxN Hcrmitian positive-definite matrix (i.e. x*YjX > 
for all non-zero x G C N ), and p G {1, 2, . . . , N} U (N, oc). We will say that a 
random Hcrmitian matrix W has complex Wishart law with shape parameter p 
and scale parameter E if the joint Laplace transform of its entries is 

(1.1) E (exp(tr(0W))) = (dct(J - 9Y,))- p 

for all Hcrmitian matrices 6 such that E _1 — 9 is positive-definite. 

We write W G VVjv(E,p). This notation is deliberately modeled on ([Anderson 2003|, 
Section 7.2), but the reader should keep in mind that this paper is devoted solely 
to the complex case. 



From Gindykin's theorem, see (Graczyk, Letac & Massam 2003), we know that 



is indeed the Laplace transform of a probability measure which is supported 
on the set of TV x N Hcrmitian positive matrices, (i.e. on A such that x* Ax > for 
all x G C ). It is also well known that W G Wat(E,p) with p G N can be expressed 
as a quadratic form in a complex Gaussian matrix with i. i. d. entries, see (13.41) . 

Asymptotic normality for traces of polynomials in a single real Wishart matrix 
with E = / is known since the work of (jArharov 1971[) and (jJonsson 19821 Theorem 
4.1), who relied on combinatorial methods similar to ours. More general unitary- 
invariant ensembles have been studied starting with (|Diaconis fc Shahsha hani 1994ft ; 
for recent work and references, sec dCollins, Mingo, Sniady fc Speicher 2006[ ). 
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(jBai fc Silverstein 2004j) proved asymptotic normality and derived elegant inte- 
gral formulas for the means and the variances of traces of analytic functions of 
a more general class of empirical covariances. Asymptotic normality for multi- 
matrix models was studied in (jCabanal-Duvill ard 2001]) who used stochastic anal- 
ysis to establish asymptotic normality for traces of polynomials in two indepen- 
dent complex Wishart matrices with £ = I, and in QMingo fe Nica 2004| and 
QKusalik, Mingo, fc Speicher 2005D who studied polynomials in several independent 
unitarily invariant Wishart matrices by combinatorial methods. 

Our main result extends (Mingo fc Nica 2004| Corollary 9.4) to more general 
covariances, and is proved by the closely related combinatorial method. 

Theorem 1.2. Fix X±, .. . , X s > and let Pj(N) = \XjN~\, j = 1, . . . , s. Fix a 

sequence of positive-definite N x N matrices Ci(iV), . . . , C S (N) such that 

w rrm o itr( 9 (C 1 (iV) J ...,C s (iV))) 

exists for all non-commutative polynomials q G C(xi, . . . ,x s ). Suppose £ 
W N (jjCi{N), P i(N)),...,wi N) 6 W N (±C s (N), Ps (N)) are independent. 

Given polynomials qi, . . . , G C(xi, . . . , x s ), define the C d -valued random vari- 
able Z N = fa(N),...,£ d (N)) by 

&(JV)=trfo(W< W \...,W< JV >)). 

Then there is a pair (X, Y) of jointly Gaussian mean zero M. d -valued random vari- 
ables such that 

Z N -E(Z N ) ^X+ tY. 

The statement of Theorem 1 1 . 2 1 does not specify the covariance matrix of the lim- 
iting normal law, and usually the law of Z = X-HY fails to be "complex Gaussian" , 
as the covariances of X and Y may differ. The expression for the joint (2d) x (2d) co- 
variance of (X, Y) that can be read out from the proof becomes more explicit in sim- 
ple situations, see Example l 5 . 1 1 below . More convenient representation of the covari- 
ance could be of interest to statistics, see ( |Edelman, Mingo, Rao fc Speicher 2006[ ). 

We remark that if Xj > 1 for some j, we can take as shape parameter pj = 
XjN instead of the first larger integer \XjN~\. We also note that under natural 
assumptions, the centering is linear in N, see (|2.10l) . 

Theorem 1 1.2 1 is a consequence of a number of non-asymptotic results. In Section 
d]we state the formula for mixed moments of traces of monomials in independent 
Wishart matrices, and we use it to derive some of the explicit expressions available 
in the literature. In Section [3] we prove the formula for moments. In Section [4J we 
compute multivariate cumulants of the traces of monomials in independent Wishart 
matrices. In Section [5] we use the cumulants to prove Theorem II. 21 

2. Mixed moments of independent complex Wishart matrices 

Explicit formulas for moments of polynomials in one complex Wishart matrix ap- 
pear in (|Lu fc Richards 2001[) . (Hanlon, Stanley fc Stembridge 1992), QGraczyk, Letac fc Massam 2003 ) 



Haagerup and Thorbj0rnsen ( |Haagerup fc Thorbj0rnsen 2003 ) compute the gener 



ating function Str(expsW) for Wishart matrices W with scale parameter S = /. 
Mingo and Nica ( |Mingo fc Nica 2004[ ) give explicit formulas for moments and cu- 
mulants of monomials in several independent Wishart matrices of the same shape 
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parameter p and the same scale parameter £ = /. Here we adapt their technique 
to more general shape and scale parameters. 

2.1. We consider moments of monomials qn,t,h{xi, x 2 , . . . , x s ) of degree n in 
non-commuting variables Xi,x 2 , . . . ,x s , which are parameterized by permuta- 
tions tt £ S n , functions t : {l,...,n} — > {l,...,s} and matrix- valued functions 
h : {1, . . . , n} — > A / f„ X n(C). The interpretation of these parameters is as follows: 
the cycles of permutation it determine how the monomial is factored into the prod- 
uct of traces; index t(j) describes which of the variables appears at the j-th position 
in the monomial, and h(J) is an optional parameter which can be used, for example, 
to extract information about the moments of a single entry of the product. 
Let C(cr) denote the set of cycles of permutation a. Define 

(2-1) g CT)t ,/ l (xi,x 2 ,...,x s ) = Y[ tr I II ft C7') x t(j) ) ' 

cec(o-) yec / 

Here the notation tr ^Hjec ^(i) x *0')J ^ s to ^ c interpreted as the trace of the product 
of the matrices taken in the same order in which the integers j appear in the cycle 
c. If h = I we will write q a ,t,i] if i = 1, we will write q a ,i,h- 
For example, (tr(WiW 2 )') 2 = g ffA /(Wi, W 2 ) with 

(2.2) a =(1,2), (3, 4), t(j) = (3 + (-1)^/2. 

Clearly, this representation is not unique; ( jHanlon, Stanley fe Stc mbridge 1992) 
index their monomials by the cycle type of permutation a, i.e., by a partition A h n, 
see Corollary 12. 31 However, the statement of Theorem [2TT] relies on compositions of 
permutations, so the notation q w t,h is more convenient here. We also remark that 
monomials q a ,t,h are natural generalizations to several variables of the monomials 
r a introduced in ( jGraczyk, Letac fc Massam 2003[ ) , see Corollarv l2.2l 
For a fixed t ; {1, . . . , n} — ► {1, . . . , s}, let 

(2.3) S n {t) = {ir€S n :t = toTr} 

be the set of i-preserving permutations. Under the interpretation that t assigns one 
of the s colors to each of the integers {1, . . . , n}, these are "color-preserving" permu- 
tations, and this is how we will refer to them. Each a 6 S n (t) may be identified with 
the fc-tuple of permutations of the k nonempty sets among f -1 (l), t^ 1 (2), . . . , i _1 (s). 
Accordingly, we decompose the set of cycles C(ct) = Uj=i Cj( a ) m t° the union of 
sets Cj(a) of cycles on £ -1 (j), j = 1,2, ... , s; here we allow the possibility that 
t _1 (j) = for some j, in which case Cj =0. 

If er, a 6 S n , by aa we denote the composition of permutations, i.e. the permu- 
tation a o a. 

With the above notation, we state the main result of this section. 

Theorem 2.1. IfW 1 e Wjv(£i,Pi), W 2 £ Wjv(S 2 ,p 2 ), . . . , W s £ W N (Z 3 ,p s ) 
are independent and a G S n , then 

(2.4) B(? ffAh (Wi,Wj,...,W,)) 

V „#Ci(")„#C2(a) „#C s (a) fy y y N 

— Pi P 2 -■■Pa qaot,t,h\^li 2->2, ■ ■ ■ , Z->a)- 

oes„(t) 
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Theorem 12.11 follows by induction with respect to s from the formula in 
flGraczyk, Letac fe Massam 2003[ Theorem 2), which we state as Corollary [272] be- 
low. However, the notation for such a proof is cumbersome, so in Section [3] we give 
a direct elementary proof based on techniques of ( Mingo & Nica 2004 1 . 



2.2. We now use Theorem 12.11 to derive several explicit formulas which already 
have appeared in the literature. (The statements are re-cast into our notation.) 

Corollary 2.2 (( |Graczyk, Letac fe Massam 2003] Theorem 2)). For tt G S n , h : 

{1, . . . ,n} — > Mnxn(C), define 

r„(hi, . . . ,h n )(x) = Y\_ tr U x ^ 

cGC(tt) \j£c 

IfW G W N (£,p), then 

(2.5) E(r 7ro (h 1 ,...,h n )(W)) = P* C{ ^ o) r^{hi,---,K){T,). 

Proof. Notice that 7ri and 7rf 1 have the same cycle type (i.e., their cycles have the 
same lengths), and 

trC-Ma ...A k ) = ti(A* k ...A* 2 Al). 
Since t = 1, we have S n (t) = S n . So with a = n^ 1 , formula (|2.4[) gives 

s(r W0 (/ii,...,/i„)(W)) =E(q a j Jl ,(W)) = P #C(7r) ^,l,ft.(S). 
Substituting tt^ 1 = an we get 

E(r n (h u ...,h n ){W)) = P^^^A.H-W 

= p#^o^ 1 )^ 1 (h 1 ,...,h n )(j:). 

This ends the proof after we recall that conjugation preserves the number of cycles: 
since aa and a a are conjugated, 

(2.6) #CM = #C(aa). 

□ 

Corollary 2.3 (( |Hanlon, Stanley fc Stembridge l992| Corollary 2.4)). For A = 
(Ai, A 2 , . . . ) b n, letp x (x) = tr(x Al )tr(x As ) .... If W G 14V(/,p) 7 and <r G <S n /ias 
cyc/e type A ; iften 

(2.7) £?(p A (W)) = p #c(a) 7V #c(a CT )_ 

q£5„ 



Proof. Since p\(W) = q a ,i,i(W) and tr(J) = N, (HTJ) follows from dHJ) by l[2~6]) . 

□ 



Corollary 2.4 (( [Mingo fc Nica 2004| Lemma 9.1)). IfW u W 2 , . . . , W s G WW(I,p) 
are independent, then 

(2.8) %, U (Wl,...,W s ))= ^ p #C(a )iv #C(a-V)_ 

a£5„(t) 
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Proof. Using (|^6| . 

S(g ff , t , J (W 1 ,...,W a ))= ]T p#C(a )7v #C( a a) = £ p #C(a- 1 )j V #C(a- 1 ( ,) j 

a6S„(t) a- 1 G5„(t) 

which gives Iplij) . as #C(a) = #C(a~ 1 ). □ 



For asymptotic normality in Theorem 1 1.21 it is interesting to determine how the 
first moment of a trace depends on N in a special setting. 

Fix n > 1, <t = (1,2, ...,n) £ 5„, i : {l,...,n} — > {l,...,s}, and A > 0. 
Let S°(t) C 5 n (i) denote the set of color-preserving permutations a such that 
#C(a) + #C(aa) = n + 1. 

Corollary 2.5. Suppose W[ N) , . . . ,W ( S N) G W N (C N /N, \\N~\) are independent. 
If there exist numbers mfc such that 

(2.9) lim tr(C^) - Nm k = 

N— >oo 

for all k € N, iften 

(2.10) to o ( r ^(tp(w<g...wg? ) ))-jv e a #cm n = °- 

\ «e5°(t) cec(o-Q) / 

Proof. Denote p(JV) = \XN]. By Theorem EU 

^(tr(wW...w£))) 

= N (Ptp.\* C(a) N #C (a)+ #C (aa) -n-l trjv(C # c ). 

ae5„(t) ^ ' ceC(<jQ) 
It is known, see ( |Jacques 1968[ ) and (jMachi 1 984, Theorem 1), that 

(2.11) #C(a) + #C(a) + #C(cra) = n + 2 - 2.g 

for some g = g(a) G {0,1,..., [(n - l)/2j}. Clearly, g(a) = for a e S°{t). 
Therefore, 



e (^) n ^(cf)- n 

ES°(t) ^ ' \cGC(<tq) ceC(cra) 

LO"l)/2j / / wU #C(a) 



#C(a) 

TO #c 

aeS°(t) x 7 cGC(cra) 

#C(a) 



» e (^p 1 n 



e e (^f 1 ) ^- 2s n ^(^ c )- 



9=1 agS„(t):j(a)=j x ' ceC(cra) 

Since n is fixed, p(N)/N -» A and (|2~9f holds, this implies (|2~T0| . 



□ 



Remark 2.6. Inverses of permutations in 5° appear in (jBiane 1997[) . see the dis- 
cussion of noncrossing permutations in (Mingo fc Nica 2004} Remark 2.10). 
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Example 2.1. Under the assumptions of Theorem 12.11 formula (|2.4p used with 
h(l) = Eij, the matrix with exactly one non-zero element at (i,j)-th position, 
h = I otherwise, gives 

E WW, . . . W s ) = pip 2 ■ • .J5 s £i£ 2 . . . S s . 

Indeed, we can identify the (i, j)-th entry of the matrix on the left hand side from 
E (tr(£ijWiW2 . . . W s )). The only color-preserving permutation is the identity 
permutation. Of course, the same answer arises by conditioning from the univariate 
case. 

2.3. Example of covariance calculation. The purpose of this section is to illus- 
trate certain graphical representations which will be used in Theorem 14.61 and to 
derive formulas for Example 15.11 

For complex-valued square-integrablc random variables £, rj, we denote 

(2.12) covK,T?)=E(£j)-E(flEfa); 

in this notation, cov(£, £) is a complex number. 

Suppose Wi, W2 are as in Theorem 12.11 so tr(WiW2) is real- valued. From Ex- 
ample [2~T1 we know that B(tr(WiW2)) = piP2tr(£i£2). To compute the variance 
of tr(WiW 2 ) we therefore compute S(tr 2 (WiW 2 )) using (|2.4[) with n = 4 and a, t 
from $2% . 



a 

aa 


(1)(2)(3)(4) 
(1,2)(3,4) 


(1)(3)(2,4) 
(1,2,3,4) 


(1,3)(2)(4) 
(1,4,3,2) 


(1.3) (2,4) 

(1.4) (2,3) 


contribution 


p?pltr 2 (EiE 2 ) 


p?P2tr((S 1 E 2 ) 2 ) 


Pl p|tr((EiE 2 ) 2 ) 


pip 2 tr 2 (E 1 E 2 ) 
















graph 


12 | 4 
• • 


4 

2 

• • 


12 | 4 
• • 

X V 


2 

• • 




1 | 3 | 


1 1 3 | 


X V 




O O 












Table 1. 



Four possible a € S4(t) and their contributions are listed in Table [T] The last 
row shows graphical representations of the [airs (a, a) which we will use in Section[4] 
the cycles of a as cyclic clockwise permutations of edges around the black vertices, 
and the cycles of a as cyclic clockwise permutations of edges around the " colored" 
vertices marked as circles. The first graph corresponds to (£(tr(W 1 W 2 ))) 2 , so the 
remaining connected graphs give the terms contributing to the variance. Similar 
situation occurs for higher order cumulants, where again the contributions come 
only from the connected graphs. 

Similarly, we can analyze tr(WiWaW3). With a = (1, 2, 3)(4, 5, 6), there are 
seven terms contributing to cov(tr(WiW2W3),tr(WiW2W3)). Graphical repre- 
sentation of one such term with contribution pip2P3tr((EiS2£3) 2 ) is depicted on 
the right in Fig. [1] We have therefore the following formulas. 
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Example 2.2 (Example ED continued). If Wi G Wjv(£i,2>x), W 2 G WAr(£ 2 ,p 2 ), 
W3 G Wat(E3,P3) are independent, then 

Var (tr(WiW 2 )) = p 2 p^ f — + — ] tr((E 1 E 2 ) 2 ) + Pl p 2 tr 2 (S]iS] 2 ); 

\Pl P2/ 

(2.13) cov(tr(W 1 W 2 W 3 ), tr(WiW 2 W 3 )) 

= P?p!p§ (- + - + -) tr(( Sl S 2 I]3) 2 ) 

\Pl P2 P3/ 
+ PiP2P3(pi +P2 +p 3 )tr 2 (SiS 2 S3) +PlP2P3tr((SiS 2 S]3) 2 ). 

In particular, if p\ = P2 = P3 = P and £1 = E 2 = S3 = S then 

cov(tr(W 1 W 2 W 3 ), tr(W 1 W 2 W 3 )) = 3p 5 tr(£ 6 ) + +3p 4 tr 2 (£ 3 ) + p 3 tr(£ 6 ). 

A similar calculation yields 

cov(tr(W 1 W 2 W 3 ),tr(W 3 W 2 Wi)) = 3p 5 tr(S 6 ) + 3p 4 tr(S 2 )tr(E 4 ) + p 3 tr 3 (E 2 ). 

3. Proof of Theorem 12.11 

In the proof, by [A]i j we denote the (i,j)-th element of A. It will also be 
convenient to write hj = h(J). 

Following ( Mingo fc Nica 2004| , we write q v ,t,h(*-i, ■ ■ ■ , x s) as follows. 

Lemma 3.1. 

n 

(3.1) q*,t,h(x-i, ■ ■ ■ ,x s ) = 2J ~\[hi~Kt{i)]j(i),j{ir(i))- 

J:{X,...,n}->{X,...,iV} i=l 

Proof. For a single cycle c = i 2 , . . . , of 7r, 

JJ(i),J(^(i)) 



tr I JJ /i r x t ( r ) J = ^2 ~[[[ h i x t(t)}. 

Vrec / J:c-^{X,...,JV} iGc 



Thus 

<?7r,t,/i(xi, . . . ,X S ) = ^2 ~J[hiX. t (i)]j{i) ,J(7T(t))) 

J:{X,...,n}->{X,...,W} cGC(tt) iGc 

and (|3~Tj) follows. □ 



Proof of Theorem \2.1\ We first reduce the proof to the case when the shape param- 
eters pi, . . . ,p s arc positive integers. By independence and (jl.ip . the joint Laplace 
transform of Wi, . . . , W s is 

E [exp(^tr(0 r W r )) ) = f[ (det(7 - E r 6» r )) _p " . 

\ r=l / r=l 

Denote r ,i,j,O = ^[^r]i,j, #r,i,j,X = 9[^]t,ji Wr-,i,j,0 = S[W r ]y, Wr.iJ,! = S[W r ] ?J . 

Since 

AT JV 

tr(0 r W r ) = ^ ^,1,1,0^,4,1,0 + 2 ^(^ij.pWf,!,,^ -I- O r .ij^W r ^j t i) 

i—l i—1 j<i 
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we therefore can compute the expectations of the entry-wise products 



(3.2) Y[(2-S lk . Jk )E[Y[W, 

0" 



k=l \k=l 



\ (det(j - £A))~ Pr 



=e s =o 



for any 1 < 7*fc < s, 1 < ik,jk < N and sj. G {0, 1} such that = when ik = jk- 
As a function of pi, . . . ,p s , the right hand side of (|3.2|) is a polynomial. Since the 
left hand side of ()2.4j) is a linear combination of the expressions appearing on the 
left hand side of (|3.2j) . this shows that (|2.4p is an identity between polynomials so 
it is enough to prove it for pi,P2, ■ ■ ■ ,Ps £ N. 

We now prove (|2.4p with the assumption that pi,P2, ■ ■ ■ ,Ps G N. For r = 
1, 2, . . . , s, let X r be a, p r x N matrix with i. i. d. complex normal entries such 
that for i = 1,2, . . . ,p r , j = 1, 2, . . . , N we have 



(3.3) £([X r k,) =£([X r ]y =0, ^(HX^f j = 1. 

We also assume that matrices Xi,...,X s are independent. It is well known 
f (|Goodman 1963b[) l that with S r = A r A*, formula 

(3.4) w r = A;x;x r A r 

defines independent complex Wishart matrices W r E WV(£ r ,p r ), r = 1, . . . , s. 

Expanding matrix multiplications in (|3.ip . we write the polynomial on the left 
hand side of (12.41) as 



(3.5) ga,t,/ l (Wi,W 2 ,...,W s ) 



J,K,L,M \i=l j 



X 
1=1 



where the sum is now taken over all functions J,K,M : {1, . . . , n} — > {1, . . . , N} 
and over all functions L from the set 

C := {L : {1, . . . , n} -> N : L(i) < p t(l) for all i}. 

Wick's formula expresses the expectation of the product of jointly normal cen- 
tered random variables as the sum over all pairings of products of covariances. 
Under (|3.3[) . the only contributing pairings are those that pair [X*/^]^- with 
[^-t(j)]L(j),M(j) ■ Thus the contributing pairings are determined by the pairs (i, a(i)) 
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with a s S n (t), and the expectation becomes 

= e ^ n [ x *«]L(i),jf(<)[ x tw<))] i («w).wwi)) 

aeS n (t) \i=l ) 

= E ^L=Loa,M=Koa- 1 - 
a£5„(t) 

This allows us to write the expectation of (|3.5|) as 
S(g ff)tlh (Wi J W 2j ... J W i )) 

J,K,L,M a eS n (t) i=l 

n 

=e X! ii = Loct n[ /ii " 4 t(')] j ( 4 ). if ( i )[" 4t ( i )]^( Q_i ( 4 )). j ( CT ( t )) 

J,K aeS„{t) L£C i=l 

Since = ^aT 1 ^')) and ^Le£ l£=£oa = FELiP^ tllis becomes 

s / n \ n 

E Y[pt Cr{a) E n^tcoUo.^M ) n^*(«- 1 «))]if(o ! - i a))^^a)) 

a6S„(t) r=1 ,7.A" \i=l / j=l 

s n 

= e ii p * Cr(a) e n^^w^w.^w^twi^w.^^caw)) 

a£<S„(t)r=l J,Ai=l 

s n 

= e n^^En^^wi^^)) 

c*e<S„(t)r=l ,7 i=l 

= e n tofn^w^w) 

a£S„(t)r=l ceC(o-a) Wc / 

= e Ek #£vw n trfn^w) 

= E npf v(a W,/i(Si,Sa,...,S a ). 

a£S„(t) r=l 



4. Formal power series, cumulants, and graphical enumeration 
As a motivation, consider the integral 
(4.1) Z N ( Ul ,...,u m ):=E{e- NV ^-^), 
where 

m 

F U (W 1; . . . , W s ) = ^ % tr( gi (W 1; . . ., W,)), 
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and qi, . . . , q m £ C(xi, . . . , x s ) are non-commutative monomials. Of course, the 
integral might diverge, so it cannot be studied without additional assumptions. In 
view of recent progress (Maurcl-Scgala 2006) in multimatrix models, it would be 
interesting to find the sufficient conditions for the asymptotic expansion as N — > oo 
for IxiZn. 

In this section our interest is limited to the formal power series expansion for 
InZjv, which is well defined without any assumptions on the monomials, and serves 
as a convenient notation to encode certain combinatorial relations. The "formula" 
we give should not be interpreted as a statement about the actual function Zjq 
that inspired the formal expansion. On the other hand, the formal power series for 
In Z/v is a well defined object which we will use to prove asymptotic normality for 
the traces of polynomials. 

In order to avoid misinterpretation, we will place the tilde over all formal power 
series, even if they arise from familiar analytic functions like ln(l + x), or exp. 

4.1. Formal power series. A ring of formal power series in m variables u\, . . . , u m 
is the set of all complex infinite sequences a = {a^,...,^ '■ kj > 0}, with the al- 
gebraic operations (linear combination, multiplication, differentiation, integration, 
and sometimes composition) that arc defined as if they were inherited from the 
corresponding operations on the infinite power series 

a(ui, . . . ,u m ) = ^ "l 1 ■■■ u ^ a ki,k 2 ,-,k m - 

fci,...,fe m >0 

Well defined operations on formal power series are those that rely only on the 
finite number of the coefficients. Thus the (ki, &2, ■ ■ ■ , k m )-th coefficient should not 
depend on the value of M when the operations are performed on the polynomials 
of degree M which were obtained by truncation mod uf 1 . . . u^f of a formal power 
series for all large enough M > Mo(ki, k2, • • • , k m ). Such operations act on infinite 
sequences a, b regardless of the issues of convergence, and the power series notation 
serves only as a convenient mnemonic device. In particular, if a is a formal power 
series in one variable, then the composition a(b) is a well defined formal power 
series, whenever &o,...,o = 0. For example, if a(u) = J2n>i "^"i then a(a(u)) is well 
defined, and the first few terms are a(a(u)) = u + 2 ■ 2\u 2 + 2(3! + (2!) 2 )u 3 + . . . . 
To shorten the notation, we will write 

a(ui,...,u m ) = X] uk Ok- 

fe 1 ,...,fe m >0 

We will also write k! = fci!^! . . . k m \. 

Every infinitely-differentiable function f(ui,...,u m ) gives rise to the formal 
power series 



f(ui,...,u m ) = ^2 

fei,...,fc TO >0 



d k k 
— u 
k! ' 



where 



du'l 1 . . . dum 



-J 



u=0 

Of course, the series does not have to converge, and even if it does, it may fail to 
converge to /(u). 
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4.2. Cumulants. The cumulants of real random variables £o>£i, • • • jCto with ex- 
ponential are often defined as the coefficients in the Taylor expansion 

v-^ (m) k 

In E exp(ttii£i + iu 2 £ 2 H h Mt m £m) = 2J "Id" Ck ' 

fci,...,fe m >i 

if £oj £1, • • • , Cm have finite moments of all orders, then the left-hand side is diffcr- 
cntiable at 0, and the cumulants can be defined as the derivatives at 0. If a family 
of complex- valued random variables £o,£i, ■ ■ • ,£m has all moments but the expo- 
nential moments fail to exist, the above approach will not work but we can still 
define the cumulants by their combinatorial relation to moments. This relation is 
encoded as an identity between two formal power series. Let L be the formal power 
series for ln(l + u). Let 

00 i k 
n=l ' n>l fciH \-k m =n 

where 



Then the composition L ^M(u)J is a well defined formal power series; formula 

(4.2) Z(M(u))= |j Ck 

fcH hfcm>l 

encodes the relation between the moments on the left hand side and the cumulants 
on the right hand side. 

We will need an explicit form of this relation due to ( |Leonov fe Shiryaev 19 59), 
see (jLando fc Zvon kin 2004, Proposition 3.8.4); we state in the form equiva- 
lent to flSpeed 1983[ (3.1)). By V[l...n] we denote the set of all partitions 
V = {Bi, . . . , B v } of {1 ... n} into the disjoint non-empty sets Bi, ... , B v , which 
are called the blocks of V. Then the cumulants Ck 1% ...,k m are determined recur- 
rently in terms of the moment Mu and the lower order cumulants as follows. Let 
n = ki + ■ ■ ■ + k m and let 

(X\, . . . , X n ) = ( £l ' §2, ■ ■■ , & , ■ ■ ■ , £m, ■ ■■ , £m )■ 

k\ k 2 k m 

To each nonempty Bc{l,...,n}we associate the corresponding cumulant 

c b : = C jl,...,jml 

with j r = jf{u G B : X u = £ r } for 1 < r < m. Of course, Ck = cb with 
B = {1, . . . , n}; other sets B correspond to cumulants of order lower than n. 
Then (|4.2p is equivalent to the following 

(4.3) M k = ^ H CB - 

V£-P[l...n] SGV 

For example, with m = 2 we have c^o = E(£±), co,i = E(^ 2 ), and ci.i = cov(£i,£2), 
consistently with notation in (|2.12[) . 

Since the cumulants determine moments, and the moments of real random vari- 
ables determine the distribution, provided they do not grow too fast, we get the 
following. 
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Lemma 4.1. If £1, . . . ,£ m are real-valued random variables with cumulants such 
that Ck = for all ki + • • • + fc m > 3 , then the joint law of (£i, . . . , £ m ) zs Gaussian. 

We remark that by (|Marcinkicwic z"T939j) . condition fci + • • • + fc m > 3 can be 
replaced by fci + • • • + k m > M for some fixed M. We also note that Lemma [4.11 
does not hold for complex random variables: if £,77 are independent, £ is iV(0, 1), 
and 77 has uniform distribution on \z\ = 1, then £ + 77 has the same moments, and 
hence the same cumulants, as the -/V(0, 1) law. 

4.3. Maps and genus. Our expression for the cumulants uses sums over the hy- 
permaps. We need to recall background information and introduce the notation. 
We will follow (jLando &: Zvonkin 2004P when possible; however we need to clarify 
the role of coloring, and our formulas use the opposite orientation on the faces. 

4.3.1. Motivation: maps and pairs of permutations. A topological (oriented) map 
M on a compact oriented surface S without boundary is a partition of S in three 
finite sets of cells: 

(i) The set V = V(M) of the vertices of M, which is a finite set of points; 

(ii) The set E = E(M) of the edges of M, which is a finite set of simple opened 
Jordan arcs, disjoint in pairs, whose extremities are vertices; 

(iii) The set F = F(M) of the faces of M. Each face is homeomorphic to an 
open disc, and its boundary is a union of vertices and edges. 

(iv) The rooted map has a selected oriented edge, i.e., an edge with an adjacent 
vertex. 

Since the graph (V, E) is embedded into S, the orientation of S determines the 
unique cyclic order on the edges adjacent to each vertex. (In the drawings, we 
will always follow the clockwise direction.) We note that the same graph can be 
embedded into S in many ways, see (jLando fc Zvonkin 20041 Fig. 1.17). 

The genus g = 0, 1, 2, . . . of a map M is the genus of surface S, and is determined 
from Euler's formula 

(4.4) #y - #£ + #F = 2 - 2.g. 

(In particular, all maps on S have the same genus.) 

A rooted combinatorial map is an ordered pair of permutations (er, a) £ S n x S n 
acting transitively on {1, . . . , n} such that a is an involution with no fixed points. 
Such a pair is identified with the topological map M = (V, E, F) through the 
associated sets of cycles, with V — C(a), E — C(a), and F = C{aa). As the rooted 
edge we take the cycle (1, a(l)); as distinguished vertex we take the cycle of cr which 
contains 1. It is known that (V, E, F) can be embedded into an oriented surface 5, 
see (jLando fc Zvonkin 2004[ page 35). 

Conversely, to any a graph (V, E) with fixed cyclic order on the edges adjacent 
to each vertex, we can assign a pair of permutations as follows: we color all vertices 
"black", split each edge in two by inserting a "white" vertex in the middle. We 
then label all new edges by numbers 1, . . . ,n with n = 2ffV. (For rooted maps, 
we label with 1 the distinguished (half) edge adjacent to the distinguished vertex.) 
Define a G S n as a permutation whose cycles are labels of edges adjacent to each 
black vertex taken in the cyclic order inherited from the map. Define a as the 
permutation whose cycles are labels of edges adjacent to each white vertex. 
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We remark that the standard notation for the permutations [a, a) of a map is 
(<t, a, 4>) with <fi = a~ 1 a~ 1 representing the faces; our use of act instead of </> yields 
the opposite orientation on the faces and is more convenient in formulas below. 

4.3.2. Hypermaps with coloring. 

Definition 4.2. A hypermap H is any ordered pair of permutations (a, a) S S n x 
S n which acts transitively on {1, . . . , n}. The genus g = g(H) is defined by (|2.11[) . 

Clearly, 2g < n — 1, and by a result of \ Jacques 1968[), g is a non- negative 
integer. (For an accessible algebraic proof see (jMachi 1984| Theorem 1). For a 
graph-theoretic proof, see (jLando &: Zvon kiii 2004, Proposition 1.5.3).) 

We will actually use colored hypermaps, where a e S n (t). Following (|Lando fc Zvonkin 20041 
Section 1.5), we will identify each hypermap with a bipartite rooted colored map 
H = (V = Vq U [J; Vj f E, F) whose black vertices are Vq = C(a), and colored ver- 
tices of color j are Vj = Cj(a). The edges are E = {1, . . . ,n} and the faces are 
F = C(aa). 

This identification can also be described as follows. Given a colored connected 
bipartite map H = (V = Vq U {JjVj,E,F) in which colored edges connect ver- 
tices in Vo to the colored vertices of matching color in Uj>i Vj> we identify (label) 
E = {1, . . . , n}; the root edge is labeled 1. We define a as a cyclic permutation, in 
clockwise direction, of the edges attached to each vertex in Vq. We define permu- 
tation a as the cyclic clockwise permutation of the edges attached to each of the 
colored vertices. Thus a, a S Se, and a is color-preserving. Under this identifica- 
tion, formula (|2.11j) is just Euler's formula, so g <E {0, 1, 2, ... , \_{n — 1)/2J}. 

We now introduce the bip&xtite maps with stars of type qi, ■ • ■ Qm 

; this termi- 
nology is motivated by ( |Guionnet fc Maurel-Segala 2005[ ). 

Definition 4.3. Let qi, q^, . ■ ■ , q m be (ordered) sequence of monomials of degrees 
ill, ■ ■ ■ j Th m > 1 in non-commutative variables Xi, . . . , x s . Let n = ni + • • • + n m 
denote the degree of the product qiq2 ■ ■ ■ q m - Let t : {1, . . . , n} — > {1, . . . , s} be the 
coloring of {1, . . . , n} according to the labels of variables Xi, . . . , x s in the monomial 
qi . . . q m . The set of hypermaps H(qi,q2, ■ ■ ■ , q m ) with stars of type (qi, q 2 , . . . q m ), 
consist of pairs (er, a) such that 

(1) permutation a £ S n is fixed as 

a = (1,2, . . . ,m)(ni + 1, . . . ,m +712)1 • • • , (ni H hn m _i + 1, . . . , m H hn m ). 

(2) permutations a £ S n (t) vary among the color-preserving permutations such 
that the action of the group (o~,a) on {1, . . . , n} is transitive. 

In graph language, H(qi, q%, . . . , q m ) is the set of rooted bipartite colored maps 
(V = Vq U V C ,E,F) with m black vertices Vb of degrees deggi, . . . ,degg m corre- 
sponding to the monomials qi, q%, ■ . ■ q m . The n edges are labeled, cyclically ordered 
at each black vertex, and colored with different colors associated to each variable 
x j , i G { 1 , . . . , s}, colored clockwise in the same order in which they appear in the 
monomials. The number of the colored vertices V c and the ordering of their edges 
are not specified and vary subject to the following constraints: every edge connects 
a black vertex to a colored vertex, and only edges of the same color may connect 
to the colored vertex. The root edge corresponds to the first variable in q\. 

All edges in the graph have natural orientation from the black vertex to the 
colored vertex. The cycles of permutation a list edges adjacent to a given black 
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vertex in clockwise direction. The cycles of permutation a give the clockwise order 
of the edges adjacent to a colored vertex; all these edges are required to have the 
same color. Then the cycles of a a list those edges of a face that are in counter- 
clockwise (positive) orientation with respect to that face, see Fig [I] 
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Figure 1. On the left: two stars of type X1X2X3 for calcula- 
tion of f2T3]) . Here a = (1, 2, 3) (4, 5, 6) On the right: the 
rooted colored hypermap of genus 1 with a = (1, 4)(2, 5)(3, 6), 
aa = (1, 5, 3, 4, 2, 6). The edges are oriented from the black to the 
colored vertices, and the root edge is marked by the double arrow. 
This hypermap has one face with the boundary 14523641_2563; 
the underlined edges have negative orientation and do not appear 
in the cycle representation. 

By Vj we denote the set of all vertices in V c linked to an edge of color j G 
{1, . . . , s}. We will also need the following special notation. 

Definition 4.4. If / is a face corresponding to a cycle c = (ji, J2, ■ ■ ■ ,jk) of era, 
by trjvC-f'* or by tr^C^* we denote -^tr (C t(jl )C t (., 2 ) . . . C t(jfc) ). 

4.4. Genus expansion for the partition function. 

Definition 4.5. We define the formal power series lnZjv(u) as the composition of 

the formal power series L(Zn{u) — 1), where L(z) = X)^Li(~ 1 ) n+1 7T ^ s * ne f° rrna l 
power series of the function L(z) = ln(l + z), and 

(4.5) Z N (u) = Y, N kl +-+ k -t^lE (n^(9 J -(Wi,...,W s )) j . 

Of course, the latter series is the formal power series of directional derivatives at 
zero of function Zn(u), when the monomials qi, . . . q m are such that the integral 
(|4.1|) converges for ui, . . . , u m > 0. Even if the series fails to converge, the coeffi- 
cients of In Zn(ui , . . . , u m ) are the multivariate cumulants of the family of random 
variables 

6 = Ntr( qi (W b ..,, W,)), . . . , £ m = iVtr(g m (W!, . . . , W,)), 

Let 7i((?,k) denote the set of hypcrmaps of genus g with kj stars of type qj, 
j = 1, . . . , m. Note that since k is an ordered m-tuplc, all hypcrmaps in 7i(0, k) U 
W(l,k) U .. . share the same a = aw and coloring t = tk, and they differ only in 
the choices of a. 
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Theorem 4.6. J/Wi G Wjv(^Ci, JVAi), . . . ,W S € Wjv(^C s , ATA S ) are indepen- 
dent, then 

( 4 -6) ^^( U ) = E^ E ^c(k,.9,C), 

g>0 fciH hfc m >l 

where 

C (k, 5) c)= 2 nAriw c/i 

(V,E,F)£?i(g,k)r=l /e_F 

Proof. The idea of proof is fairly simple to describe. By Theorem l2.1[ formula (|4. 5[) 
can be reinterpreted as a generating function of disjoint unions of hypermaps. It is 
well known in combinatorics that a logarithm of such a generating function is the 
generating function for the connected objects of the same type, provided that the 
coefficients are multiplicative. More precise statement relies on cumbersome nota- 
tion, see the last two paragraphs that precede (jLando fc Zvonkin 20041 Proposition 
3.8.3); a simpler version of the multiplicative property in ( |Stanley 1999[ Corollary 
5.1.6) is too strong for our needs, so we will verify directly (|4.3[) . 
For ki + ■ — h k m > 1, denote 

M k = E ^jj tr*' (jj(Wi, . . . , W s ))j . 

With rij = deg(gj) > 1, denote by = k\n\ + • • • + k m n m the degree of the mono- 
mial q kl . . . q^ 1 , and let tk : {1, ■ • ■ , ^k} — ► {1, ■ ■ • , s} be the mapping identifying 
the variables in this monomial. Let a G iS„ k be the permutation with kj cycles of 
length rij, j = 1, . . . ,m, so that JXjLi trfcj (ij ( x i i ■ • ■ = x s)) = ?<7,t k ,i(xi, • . • ,x s ) as 
in (f2~Tj) . From (f2~4j) we have 

M k = E(q^ tk j(W 1 ,...,W s )) 

= E f[(\ r N)* c ^N* c ^- n « l[ tr w C c ' 4 

= N* c ^+* c ^- n - f[ X# c ^ 11 tr^C^ 4 . 

QG5„ k (t k ) r=l cSC(cra) 

Combining this with (|4. 5|) and using the fact that #C(<r) = ki + ■ ■ ■ + k m , we get 

M k = ^ e jvx(<t,q) ri A > #Cr(Q) n ^c '*, 

<reS nk a£S„ k (t k ) r=l ceC(aa) 

where x(^,a) = #C(tr) + #C(a) + #C(aa) - n k . We note that by (pnTj) . we 
have x(f) <x) = 2 — 2<? when the group (a, a) generated by a, a acts transitively on 
{1, ... ,nk}. In general, we decompose {1, . . . , rik} into the orbits of (a, a). Since 
the edges of each star of type qj are in the same orbit of (a, a) , there are at most 
n := k\ + ■ ■ ■ + k m orbits, which arc determined by the following procedure. 

• Fix the sequence of polynomials (stars) 
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• Choose a partition V = {Si, . . . , B v } of {1, ... , n}. The blocks of V repre- 
sent the clusters of connected stars with no connections between different 
blocks. Each such choice splits a G 5„ k into the uniquely determined per- 
mutations <jb of the edges of stars assigned to block B £ V. 

• Sum over all color-preserving permutations a £ S nk (t) which connect the 
stars within each block at least once. Each such permutation can be split 
into the sequence of color-preserving permutations as of the edges of stars 
in block B € V, and (<jb,czb) acts transitively on the set of edges of the 
stars in B. 

For Bc{l,..., n}, wc denote by Ti.(B) the set of all hypcrmaps with stars of type 
{Qj '■ j £ B}, which we order according to their position in (|4.7| . Let Sg(t) be 
the color preserving permutations of the edges of stars in block B G V such that 
{(tb-i&b) acts transitively. Using this notation, we have 

M *= E II E ^M|] A #CW Y[ tr w C c ' 4 

VeV[l...n] BGVaGSg(t) r=l cGC(asa) 



= E II E N 2 -^Hx*^i[t IN cf'K 

VeP[l...n] B<EV H=(V,E,F)£H(B) r=l feF 

Comparing this to (|4. 3[) with £j = tr(qj(Wi, . . . , W s )), j = 1, . . . , m, we see that 
the corresponding cumulants arc 

L(n-1)/2J 

Ck = e e A^n^iw^ 

g=Q H=(V,E,F)eH(g,k) r=l /£F 

so 

^i^(u) = £ E n!r c ^ 2 

n>l fciH |-fc m =n 

k L(n-i)/aj , 

=e e ^r- e e ^n^n^ 

n>lfciH hfc m =n g=0 H=(V,F,F)e?i(9,k) r=l feF 



(-u) 

9>0 " ' feiH hfc m >l 



□ 

5. Proof of Theorem 11.21 

In order for the method of cumulants (Lemma Hj} to work, we need to reduce 
the proof to the case of real-valued random variables. A sufficient condition for 
tr(q(Wi, . . . , W s )) to be real is that q is self-adjoint with respect to the involution 
* on the space C(xi, . . . , x s ) of complex non-commutative polynomials, which is 
defined by x* = xi, . . . , x* = x s , a* = a, and for P,Q € C(xi, . . . ,x s ), (PQ)* = 
Q*P*. 

Suppose {qj : j = are the polynomials from the statement of the 

theorem. If q is one of them, we can write it as a linear combination of two self- 
adjoint polynomials with real traces, q = |(g + q*) + |(g — q*) = ^(q + q*) + 
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^i{q — <!*)■ So in order to prove the asymptotic normality of a C d - valued sequence 
(tr(gi), . . . , tr(gy)), it suffices to prove the asymptotic normality of the K 2d -valued 
sequence 

(tr(gi + ql), . . . , ti(q d + q d ), itr(gi - q{), . . .,itr(q d - q* d )). 
To prove the asymptotic normality of a centered R 2d -valued sequence, by Lemma 



4.11 it suffices to show that the variances converge, and that all cumulants of order 
higher than 2 converge to 0. 

By multi-linearity of the cumulants, the joint cumulants Ck of the above real 
random variables, are the linear combinations of the cumulants of order k of traces 
of monomials in Wi, . . . , W s . Therefore, it suffices to show that all high enough 
cumulants of (now possibly complex) traces of monomials in W l5 . . . , W s vanish in 
the limit, and that the second cumulants converge. 



Conclusion of proof of Theorem ] 1.21 After the above reduction, it suffices to con- 
sider the case, when qx,...,q d are monomials in , . . . , Wi . Denoting 
|k| = k\ + ■ ■ ■ + k m , by Theorem 14.61 we have 

(5.1) Ck ( ZA 0=]>> 2 -| k |- 29 £ f[fPr^y\ #Vr l[tr N (C^(N)). 

g>0 (V,E,F)€H(g,]i)r=l ^ ' f£F 

Thus, lim^oo c w (X N ) = if |k| > 3. 

If |k =2 then since p r (N)/N — > X r and the sum in (|5.ip is over the finite set of 
g > 0, we can pass to the limit as N — > oo. We get 



(5.2) hmc k (Z N )= £ I^ Vr II m 

(V,E,F)EH(0,k)r=l f£F 

where for / = {j lt . . .,j s }, 

m f = lim hr(C t{jl) (N) . . . C tUs) (N)). 



□ 



We conclude with deriving a more explicit normalization for a special case. We 
need the following notation. Fix o~\ = (1, 2, . . . , n) £ <S„, 02 = (1, . . . ,n)(n + 
1, . . . , 2n) G S 2n , , <T3 = (n,n — 1, . . . , l)(n + 1, . . . , 2n) € 5 2 „ and t : {1, . . . , n} — > 
{l,...,s}. As previously, let S°(t) C <S n (t) denote the set of color-preserving 
permutations a such that #C(a) + #C(<7ia) = n + 1. For 



*(J) 



j < n, 
t(j -n) j > n, 



let iS|„(t) C S2n(t) denote the set of permutations a which do not preserve 
{l,...,n} and such that #C(a) + #C(a 2 a) = 2n. Similarly, let S^*(t) C 
S2n(t) consist of permutations a which do not preserve {1, . . . , n} and such that 
#C(a) + #C(a 3 a) = 2n. 

Corollary 5.1. Suppose W[ N) , . . . , W ( S N) £ W N (C N /N, \XN]) are independent, 
A > 0, and there are numbers rrik such that 

lim tr(C^) - Nm k = 

N— >oo 
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for all k. Then, as N — » oo, 

(5.3) tr( W W...wW)-iV £ ^ #C(Q) II rn^^Z, 

aeS°(t) c^C(cria) 

where Z = X + iY , and X, Y are real centered jointly Gaussian random variables 
with the covariance matrix given by: 



E {x>)=\ £ n e x#c{a ^( n ; 

aeS:*(t) ceC(a 3 a) aeSJ„(t) \ceC{a 2 a) 



e(y*)= i - 2 ^ #c(q) n e A#c(a) ^ n 

a£<S|*(t) c£C(ff 3 a) a 6>S| n (t) \cGC(o- 2 a 

^4 e a#c(q)3 ( n m H- 



1)1 



Proof. Theorem 11.21 implies asymptotic normality, and Corollary 12.51 gives the cen- 
tering, so all that remains is to determine the asymptotic variance. 

We note that if a G 5| n (t) then (a, 02) acts transitively on {1, . . . , 2n}, a pre- 
serves t, and the hypermap H = (02,0:) has genus zero. From (|5.2|) with m = 1 
and 9 i(Wi . . . W s ) = W t ( J[j . . . W t ( 2 we sec that 

E(Z>) = Hm cov (tr(W$ . . . Wj>), tr(W<$ . . . W™) 



x; n A#Cp(a) n m/ = e a#c(q) n 

(V,B,F)eW(0,2)r=l /£F «e5J„(t) ceC(cr 2 a) 



Similarly, 



E(\Zn = lim 



cov 



(ix(W<S...wW ) ),tr(Wij3...W<g)) 



= e a#c(q) n ^ 

Q£S|*(t) ceC(cr 3 ct) 

This ends the proof, as E(X 2 ) = E(\Z\ 2 )/2 + $E{Z 2 )/2, E(Y 2 ) = E{\Z\ 2 )/2 - 
5R#(Z 2 )/2, and E{XY) = %E(Z 2 )/2. □ 

Example 5.1. Here we illustrate the fact that under additional assumptions one can 
calculate explicit normalization for Theorem ll.2l From Examplcs l2 . 1 I and l2 . 21 we see 
that if Wi,W 2 ,W 3 G W N (C N /N, \XN}) are independent, limjv^oo trjv(C^) = 
m,k for all k, and limjv^oc tr(C^) — Nm^ = b, then 

tr(WiW 2 W 3 ) - NX 3 m 3 ^ X + iY as N -> 00, 

where X, Y are independent real Gaussian random variables; X has mean A 3 6 and 
variance 3A 5 mg + 3A 4 (m2??i4 + m§)/2 + A 3 m2/2; Y has mean zero and variance 
3A 4 (m2?7i4 — m§)/2 + A 3 m2/2. In particular, if Cjy = I, then X,Y have mean zero 
and variances A 3 (3A 2 + 3A -I- 1/2) and A 3 /2 respectively. 
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